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ABSTRACT 

The  master  problem  in  Benders 's  partitioning  method  is  an  integer 
program  with  a very  large  number  of  constraints,  each  of  which  is  usually 
generated  by  solving  the  integer  program  with  the  constraints  generated 
earlier.  Computational  experience  shows  that  the  subset  B of  those 
constraints  of  the  master  problem  that  are  satisfied  with  equality  at 
the  linear  ■•rograimiing  optimum  often  play  a crucial  role  in  determining 
the  integer  optimum,  in  the  sense  that  only  a few  of  the  remaining 
Inequalities  are  needed.  Hi:  characterize  this  subset  B of  Inequalities. 

Though  the  best  upper  bound  (often  attained)  on  the  cardinality  of 
B is  2^,  where  p is  the  number  of  integer-constrained  variables  that 
are  basic  at  the  linear  programnlng  optimum,  none  of  the  inequalities 
in  B is  implied  by  the  remaining  inequalities  of  the  master  problem. 

We  then  give  an  efficient  procedure  for  generating  an  appropriate  subset  | 

of  the  inequalities  in  B,  which  leads  to  a considerably  improved  version  ' 

of  Benders 's  method.  | 


BENDERS 'S  METHOD  REVISITED 
by 

Egon  Balas  and  Christian  Bergthaller 

1.  Introduction 

Consider  the  mixed  integer  program 
min  cx  + gy 

(P)  Ax  + Dy  = b 

^ J.  0 y < q, 
ye  Ci 

and  its  linaar  prograninlng  relaxation  (LP) , obtained  by  removing  the 

condition  yeO . Here  A is  m X r,  D is  m X n,  and  0 C r"  is  an  arbitrary  finite 

set. 

Benders  ( 1 ] has  shown  that  (P)  is  equivalent  to  (in  the  sense  of 
having  the  same  y-component  for  an  optimal  solution,  as) 

min  w 

o 

(P.)  w ’ (g  - u''D)y  + u’S  kcS 

1 o ~ 

0 - v'h)y  + v'^b  kcT 

q y — ® » y*^^ 

where  S <.id  T are  the  index  sets  for  the  extreme  points  and  extreme 
direction  vectors,  respectively,  of 

U ■ (ueR”*|uA  < c}  . 
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For  any  ycR**,  consider  the  pair  of  dual  linear  programs 

(LP(y))  mln{cx|Ax  •=  b - Dy,  x _>  0} 
and 

(l.D(y))  max{u(b  - Dy)|uA  < c}  . 

The  standard  procedure  (also  due  to  Benders)  for  solving  (P)  by 
using  the  above  equivalence  is  to  consider  a relaxation  (P^)  of  (P^, 
which  consists  of  minimizing  subject  to  q > y > 0,  yc fi , and  some  of 
the  constraints  Indexed  by  S and  T.  At  the  start,  the  only  constraints 
of  (Pj)  may  be  q > y > 0,  yefi.  A sequence  of  the  following  two  steps 
la  then  applied. 

— k k 

1.  Solve  the  current  (P,).  Let  (w  , y ) be  the  optimal  solu- 

1 o 

tion  obtained.  Go  to  2. 

k k 

2.  Solve  (LD(y  )).  Let  u be  an  optimal  extreme  point  of  U,  if 

k k 

one  exists;  or  else,  let  u be  an  extreme  point,  and  v an  extreme  direction 
vector,  such  that  u*'  + X.v’^eU,  ¥ X > 0,  and  v’^(b  - DyS  > 0.  In  both  cases, 
defines  for  (P^)  a constraint  of  the  type  Indexed  by  S,  while  in  the 
second  case,  v*^  also  defines  a constraint  of  the  type  Indexed  by  T.  Add 
these  constraints  to  (P^)  and  go  to  1. 

k ~ 

At  every  iteration,  the  minimum  w^  of  the  current  (P^)  provides 

a lower  bound  on  the  value  of  an  optimal  solution  to  (P^^)  , while 

V Ic  k 

u (b  - D>'')  + gy  obtained  from  solving  (LD(y  )),  provides  an  upper 

k IMS 

bound.  The  lower  bound  w is  monotone  increasing.  The  procedure  stops 

o 

when  the  upper  end  lower  bounds  become  equal. 
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I 

The  mein  difficulty  with  the  above  procedure  Is  that  in  order 
to  generate  the  subset  of  inequalities  of  (P^)  required  to  identify 
an  optimal  y,  one  has  to  repeatedly  solve  problems  of  the  form  (P^) , 
a computationally  difficult  task.  It  Is  therefore  of  interest  to  find 
other  ways  of  generating  constraints  for  (P^).  In  one  such  attempt, 

D.  McDaniel  and  M.  Devine  {2]  have  temporarily  removed  the  constraint 
yefi  from  (P^)  In  the  above  two-step  procedure,  l.e.,  have  temporarily 
replaced  (P^)  by  its  linear  prograninlng  relaxation.  This  change  amounts 
to  applying  Benders's  procedure  to  (LP)  instead  of  (P).  In  the  process 
of  solving  (LP)  by  Benders 's  procedure,  a subset  of  the  inequalities  of 
(P^)  is  generated.  Furthermore,  it  was  found  that  using  these  inequalities 
to  define  the  initial  problem  (P^)  in  Benders's  procedure  as  applied  to 
(P),  has  resulted  in  finding  an  optimal  solution  to  (P)  in  a few  iterations, 

j 

often  just  one  [2]. 

This  suggests  that  the  set  of  those  inequalities  of  (Pj^)  that  are  ^ i 

tight  for  (w^,  y) , where  (x,  y)  is  an  optimal  solution  to  (LP)  and  w^  ■ cx  + gy,  I 

1 

or  some  appropriate  subset  of  this  set,  is  a highly  desirable  starting 

point  for  Benders 's  procedure,  and  may  in  fact  yield  an  optimal  solution  ^ 

to  (P)  in  one  or  two  iterations.  The  index  set  for  these  inequalities  will 

be  denoted  by  S(y),  i.e.,  we  define  j 

S(y)  - {>t«slWo  * (g  - uS))y  + u*S).  ^ 

In  this  paper  we  describe  a new  version  of  Benders's  procedure,  j 

which  Is  a considerable  improvement  over  the  original  one.  First,  we  r 

I ' [ 

i . I I 
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characi  <trize  the  subayatem  of  those  inequalities  of  (P^  Indexed  by 
S(y)t  In  terms  of  the  simplex  tableau  associated  with  the  optimal  solu' 
tlon  (>  , y)  to  (LP) . The  cardinality  of  S(y)  la  bounded  by  2**,  where  p 
la  the  number  of  basic  components  of  y.  This  Is  a best  possible  bound, 
which  s attained  quite  frequently.  Thus  the  optimal  solution  (w^,  y)  to 
(LPj),  the  linear  programming  relaxation  of  (P^),  Is  usually' highly 
degene  ate  (2^  Is  usually  considerably  larger  than  n -f  1,  the  number  of 
Inequa  Itles  that  have  to  be  satisfied  with  equality  by  any  basic  solution). 
Nevertiieless , we  show  that  none  of  the  Inequalities  Indexed  by  S(y)  is 
redund  int,  In  the  sense  of  being  Implied  by  the  remaining  Inequalities 
of  (P^  . Thus  each  of  these  Inequalities  may  be  needed  to  define  an  optimal 
solution  to  (P^) , though  only  n + 1 Inequalities  are  needed  to  define,  to- 
gether with  the  Inequalities  y^^  > 0 or  y < q^  for  the  nonbaslc  components  of 
y,  the  optimal  solution  (w^,  y)  to  <LP^) . We  give  a procedure  i^ich  generates 
as  many  of  the  Inequalities  Indexed  by  S(y)  as  desired,  at  the  cost  of 
one  pivot  for  each  Inequality,  except  for  the  first  one,  which  requires  p 
pivots.  The  improved  Benders  algorithm  then  consists  of  first  using  the 
above  procedure  to  generate  an  Initial  constraint  set  for  (P^^),  namely 
an  appropriate  subset  of  the  set  indexed  by  S(y),  and  then  continue  as 
usual.  Computational  experiments  to  determine  the  optimal  number  of  Initial 
constr.'lnta  to  be  generated  are  under  way. 
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2.  The  Binding  Constraints  of  (IPj) 

An  optlotfl  basic  solution  (x,  y)  to  (LF),  with  the  basic  and 
nonbaslc  conponents  of  x and  y indexed  by  and  1^,  respectively, 

can  be  represented  in  simplex  tableau  format  as 


* - • + E a (-X  ) + Z a_.(-y.) 


<*)  'l  ■ ‘io  * ■ “*> 

JcJ^  jejy 


where  a , <0,  V JeJ  , and  where  (x,  y)  is  defined  by 
Oj  ” X 


*1  ■ 


io 


end 


^1- 


lo 


id 


Iv  ' 


id_ 


i«J,  . *01  < 0 

isjy  . > 0 


Here  a - cx  + ^,  the  value  of  the  optimal  solution  (x,  y) , to  (LP). 
oo 

Hot*  that  X is  an  optimal  solution  to  (LP(y)),  ' while  (w^,  y), 
where  w^  - a^,  is  an  optimal  solution  to  (LPj) , the  linear  progrannlng 
relaxation  of  (P^)  (i.a.,  the  problem  obtained  from  (Pj)  by  removing 
the  condition  y c (1) . 

He  will  assume  that  A is  of  full  roar  raidt.  Whenever  this  is  not 
the  ease,  unit  vectors  corresponding  to  artificial  variables  with  appropriate 
coats  can  be  Introduced  io  order  to  make  the  assumption  hold. 
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Now  consider  x.  As  a (basic)  optimal  solution  to  (LP(y)),  x 
Is  clearly  degenerate,  since  substituting  y for  y In  the  rlghthand  aide  vector  of 

(LP(y))  sets  ell  the  basic  variables  corresponding  to  the  rowa  Indexed  by  In 
tableau  (1)  equal  to  zero.  Thus  there  Is  more  than  one  basis  that  can 

be  associated  with  x.  Actually,  every  basis  obtained  from  (1)  by  a 
sequence  of  (1^1  pivots,  each  of  which  replaces  some  y^,  with  some 

X , lej  , produces  an  optimal  basic  solution  to  (LP(y)).  Not  every  such 
basis,  however,  corresponds  to  a feasible  solution  to  (LDCy)),  l.e.,  to 
a point  ucU.  Those  bases  associated  with  x that  correspond  to  feasible 
solutions  u*'  to  (LD(y)),  l.e.,  to  (extreme)  points  u of  U,  define  the 
Inequalities  of  (P^^)  indexed  by  S(y).  These  are  the  Inequalities  that  we 
wish  to  generate. 

Let  R (l,...,r}  and  N = [l,...,n}  be  the  Index  seta  aeaoclated 
with  X and  y reapectlvoly , ful  lei  Nj  - ij«Ni7,  - n. 

Consider  a sequence  of  simplex  tableaus  and  pivots  defined  by 
the  following  rule.  Let  the  tableau  be 

Jtj*  ■'  JeJy  ^ 

”1  ■ bo 

X y 


I 
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where  the  starting  tableau,  corresponding  to  k - 0,  Is  obtained  from  (1) 


o 

by  setting  a * a. 


IJ  iJ 


, V 1,  j,  j ^ 0;  T°  = and  J°  » for  z - x,  y; 


and 


^ ' leI°UI°U(o}. 

lo  lo  o1  J X y 


th 


The  pivoting  rule  for  the  k*'"  tableau  Is  to  choose  i*ely  and  pivot 
either  on  a , , where  j.  Is  defined  by 


(3) 


I-OJ  I 


min 


■<» 


or  on  a , , where  Is  defined  by 
★•'2 


(A) 


oj. 


mlg 


oj' 


l-ijJ  ^'*'*'*J  ' 


Note  that  upper  bounds  don't  play  any  role  In  this  rule:  y. 
ts  always  pivoted  out  of  the  basis  at  Its  lower  bound  of  0,  and  when 
the  pivoting  occurs  on  a,  , < 0,  then  x enters  the  basis  with  a negative 

value,  l.e..  Is  decreased  rather  than  Increased  from  Its  lower  bound  of  0. 
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Theoreni  1.  Kor  any  aequence  of  k pivots  following  the  rule  defined  by 


(3),  (41,  whore  0 ^ k _ ll°|, 


(5) 


w + E . > 

y 


k 

a 

oo 


Is  a valid  Inequality  for  (P^) , which  is  satisfied  with  equality  by  (w^,  y) . 

Proof.  Let  a^  and  d^  denote  the  column  of  A and  D respectively,  and 

let  Y = (c,  g) . If  denotes  the  basis  associated  with  the  k^^  tableau 

(2)  and  Y stands  for  the  vector  of  basic  components  of  y,  then  in  the 
®k 

starting  tableau  (k  =■  0)  we  have 


oj 


„-l 
B a, 
'B  o j 
o ■’ 


and 


o 


Cj::o 


Therefore  u°  = Y-  ® feasible  solution  to  (LD(y)). 

B o 
O 

Further,  the  pivoting  rules  defined  by  (3)  and  (4)  preserve  the  signs 


-1 


-1. 


of  the  coefficients  a^j  - Y^  Bj^  a^  - c^,  and  of  course  Yg^Bj^  *j  - Cj 

holds  lor  all  J«l|^  after  each  pivot. 

Hence  each  vector  u^  ■ Yo  B.  ^ Is  a feasible  solution  to  (LD(y)). 


- c.  ■ 0 


Further,  we  have 
.k 


oj 


k . 

“ "j  ■ 


and 


u d - g - 0 , 

J J 


V jsl' 


On  the  other  hand,  for  each  k we  have 


oo 
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Thus  each  inequality  (5)  can  be  restated  as 
^ (g  - u'^D)y  + , 

u 

where  u eU;  hence  each  such  Inequality  Is  valid  for  (P^) . To  show  that 

— — k “1 

It  Is  satisfied  with  equality  by  (w^,  y) , we  note  that  while  each  u - 

is  a feasible  solution  to  (LD(y)),  It  also  satisfies  the  complementary 

slackness  condition 

(c  - u^A)x  = 0 

for  X * X,  which  Is  a feasible  (and  optimal)  solution  to  (LP(y)).  Hence 
Ic 

each  u is  an  optimal  solution  to  (LD(y)),  and  therefore 
u'^Cb  - Dy)  = cx 

and  adding  to  both  sides  gy  produces 

w * cx  + gy 
o 

«=  (g  - u*^D)y  + u*^b  . Q.E.D. 

While  each  of  the  Inequalities  (5)  Is  valid  for  (P^)  and  satisfied 
with  equality  by  (w^,  y) , these  inequalities  do  not  usually  belong  to 
the  set  Indexed  by  S(y)  (or,  for  that  matter,  by  S)  except  for  the  case 
when  k » jlyl.  i.  e.»  when  » 0.  The  reason  for  this  Is  that  the 
vectors  u^  * Y,,  B.  ^ obtained  by  fewer  than  |l°|  pivots  are  usually 


-10- 


nonbaslc  feasible  solutions  to  (LD(y)).  To  see  this,  note  that  each  u 

0 

k k 

may  have  as  many  as  m -I-  |j^|  positive  components,  whereas  a basic  u is 

o k 

restricted  to  at  most  r such  components;  but  for  k < |l  |,  jj  | r - ra. 

y ' X 

On  the  other  hand,  as  the  next  theorem  shows,  all  the  Inequalities  indexed 
by  S(y)  can  be  obtained  from  (1)  by  some  sequence  of  ll°|  pivots  of  the 
above  type. 

Theorem  2.  The  constraints  of  (Pj^)  Indexed  by  S(y)  are  precisely  those 
inequalities  (5)  such  that  = N,  and  each  one  of  them  can  be  obtained 
from  the  system  (1)  by  some  sequence  of  |l°j  pivots  of  the  kind  defined 
hy  (3),  (4).  Further,  none  of  these  inequalities  is  implied  by  the  other 
inequalities  of  (P^^). 

Proof.  Slhce  A is  of  full  row  rank,  every  basic  component  of  y can  be 
pivoted  out  of  the  basis  in  exchange  for  some  component  of  x.  When  > N, 

then  I “0,  and  all  the  col  uns  of  B,  are  columns  of  A,  while  Y*  “ c . 

k -1  _ ®k  ®k 

Then  u^  •*  c„  B.  is  a basic  feasible  solution  to  (LD(y)),  l.e.,  an  extreme 

D.  K 

k 

point  of  U.  Since  the  inequality  (5)  associated  with  each  such  u was 
shown  to  hold  with  equality  for  (w^,  y) , each  such  inequality  belongs 
to  the  set  Indexed  by  S(y).  Conversely,  every  inequality  indexed  by 
S(y)  is  defined  by  an  optimal  basic  solution  u to  (LD(y)),  and  all  such 
solutions  can  be  obtained  from  the  system  (1)  by  replacing  the  components 
of  y in  the  basis  with  components  of  x,  while  preserving  dual  feasibility. 
But  the  rules  (3),  (4)  are  easily  seen  to  exhaust  the  class  of  pivots 
by  which  this  can  be  done. 
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(P  - o)y  < - Oq 
or 

py  -o(q  - y)  < 0 

which  coaCradlcts  p > 0.  Q.E.D. 

Corollary  2.1.  ls(y)|  < 2^,  where  p = i^yl*  Th^®  i®  ® t>e8t  possible  bound. 

Proof.  There  are  2^  possible  sequences  of  pivots  of  the  types  defined 
by  (3)  and  (4).  It  is  trivial  to  construct  examples  in  which  both  types 
of  pivots  are  possible  at  each  step,  since  this  is  the  usual  case.  The 
numerical  example  at  the  end  of  the  paper  Illustrates  the  point.  Q.E.D. 

The  fact  that  2^  is  a best  bound  on  |S(y)|,  which  Is  attained  more 
often  than  not,  and  yet  none  of  the  constraints  Indexed  by  S(y)  Is  redundant, 

» 

reveals  an  interesting  feature  of  problem  (P, ).  Since  n-p  inequalities 

1 ■ 

of  the  form  y^  > 0 or  y^  < q^,  corresponding  to  the  nonbaslc  components  i 

of  y,  are  satisfied  with  equality  by  (w^,  y) , only  p 1 inequalities  of 

the  set  Indexed  by  S(y)  are  needed  to  define  the  optimal  solution  (w^,  y) 

to  (LP^) . However,  since  none  of  the  Inequalities  of  S(y)  are  Implied  by  | 

the  other  constraints  of  (P. ),  they  may  all  be  needed  to  define  an  optimal 

^ 1 
solution  to  (P^) . While  this  Is  certainly  a possibility,  empirical  evidence 

Indicates  that  In  most  Instances  the  else  of  the  set  needed  to  Identify  an 

optimal  solution  to  (?^)  Is  closer  to  p -f  1 than  to  2^.  Of  course,  sane 

Inequellt'* as  Indexed  by  S\S(y)  may  also  be  needed. 

The  rule  defined  by  (3),  (4)  can  be  used  to  obtain  all  basic 

optimal  solutions  to  (LD(y)),  hence  all  the  Inequalities  of  (P^)  Indexed 

by  S(y),  by  starting  each  time  from  tableau  (1)  and  applying  |l°|  pivots. 


. S' 
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However,  after  the  first  sequence  of  pivots,  l.e.,  after  obtaining 

the  first  basic  optimal  solution  and  an  associated  tableau  (2)  with 
- 0,  there  are  better  ways  of  finding  additional  optimal  solutions, 
than  by  reverting  to  the  starting  tableau.  A much  cheaper  procedure 
Is  as  follows. 

Let  the  last  tableau  (2),  with  k * |ly|*  of  t***  form 


(2') 


X y 

- N.  This  Is  the  same  as  (2),  since  for  k - |l®|,  one  has  ly  “ ^ 

V Ir 

He  recall  that  a , < 0,  V jeJ  . Consider  now  a pivot  on  a.  . , where 

oj  - X 

1 Is  any  row  such  that  a^  . < 0 for  at  least  one  JeJ)^,  and  Is 

defined  by 


with 


(9) 


oJ. 


min 


1*oj1 


J < 0 


1.  Any  pivot  In  a tableau  of  the  form  (2'),  based  on  the  rule  (9) 
produces  a tableau  of  the  same  form,  such  that 
(10) 


w + E a^^.y . > a’^ 
° J*N  ^ 


oo 


Is  one  of  those  Inequalities  of  (Pj)  Indexed  by  S(y), 
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Proof.  The  pivoting  nilo  (9)  replace*  a baele  eatlefylng 

- Dy)  > 0, 

(10) 

c^b;^A.c<0 

irlth  a baele  aleo  eatlefylng  (10)  (with  k replaced  by  k + 1). 

Indeed,  the  choice  of  l^cl||^^  guaranteea  the  firat  Inequality  of  (10), 

while  the  choice  of  by  (9)  guaranteea  the  aecond  one.  Bence 

u'*'*’^  ■ c_  Br},  1*  * bade  optimal  aolution  to  (LD(y)).  Q.E.D. 

Vl 

Rot*  that.  In  order  to  obtain  an  inequality  (10)  from  tableau  (2^), 
on*  doe*  not  have  to  tranaform  the  whole  tableau,  but  only  the  0 row.  In 
other  word*,  a alngle  tableau  (2^)  can  aerve  for  the  computation  of  all 
the  Inequalltle*  obtainable  by  exchanging  any  on*  of  the  baaic  variable* 

-i-  for  the  approprl..te  nonbaalc  variable  x^, 

3.  An  Baoroved  Veralon  of  Bandera**  Alaorlthw 
Theorem  1 and  Bamark  1 provide  a way  of  generating  die  Inequalltle* 

of  (F^)  Indexed  by  S(y)  at  the  coat  of  on*  pivot  for  each  new  Inequality 
except  for  die  firat  one,  iRilch  require*  }l^|  pivot*. 

Aa  mentioned  above,  though  the  maximum  number  of  Inequalltle* 
obtainable  from  (1)  la  2^,  the  number  actually  needed  to  define  a linear 
program  wl  .a*  aet  of  optimal  aolutlona  la  the  aame  a*  that  of  (LP^) , la 
p 1.  Thla  doea  not  Imply  that  a^z  aet  of  p -f  1 Inequalltle*  of  S(y) 
define*  anch  e linear  program,  only  that  aueh  aubaeta  of  p -f  1 Inequalltle* 
axlat.  On*  can  uae  certain  device*  to  diooae  the  laequalltlea  that  one 
•amemtea  ao  a*  to  make  It  vary  likely  that  they  belong  to  aueh  a aubaet,  but 


dovleea  have  a eompatatlonal  coat,  and  even  if  they'prodoe* 


th«  dMlrad  result.  It  does  not  follow  thst  the  set  of  Inequsllties  thus 
obtained  Is  an  adequate  representation  of  (P^)  in  the  sense  of  having 
the  sasM  optimal  solution  (with  y c Q)  as  (P^) . 

Tharefore,  in  the  algorithm  described  below,  we  chose  the  option 
of  first  generating  t Inequalities  of  S(y)  In  a relatively  Msy'way, 
where  t Is  some  Integer  satisfying  p-i-l^t^n+l,  and  then  checking 


whether  any  additional  Inequalities  are  needed  to  define  a linear  program 


that  adequately  represents  (LP^).  In  case  the  test  is  negative,  it  also 
delivers  one  of  the  additional  inequalities  that  are  needed.  This  Is 


repeated.  If  necessary,  until  an  adequate  representation  of  (LP^)  is 
obtained.  At  that  point  the  problem  (P^^)  defined  by  the  current  set  of 
inequalities  (and  the  constraint  ycQ)  Is  solved.  The  solution  Is  then 
tested  for  optimality,  and  If  the  test  falls,  the  procedure  Is  continued 


as  in  the  original  Benders  algorithm 


To  simplify  the  exposition,  we  assume  that  (LP(y))  is  faasible 


for  all  y genarated  during  the  procedure,  i.e.,  that  T ■ 0 in  (P.) . Tha 


extansion  to  the  general  case  is  obvious 


lified  Benders  Algorithm 


Step  0.  Solve  (LP)  by  the  simplex  method  for  linear  programs 
with  bounded  variables,  and  drive  out  of  the  basis  every  y.  which  is  at  its 


lower  or  rr?*'  bound.  Let  the  optimal  solution  obtained  be  (x,  y),  let 


w > ex  -f  gy,  and  let  the  associated  simplex  tsbleau  be  of  the  form  (1). 
o 

Hake  this  into  s tableau  of  tha  form  (2),  with  k - 0,  by  raplaeing  a.  with 


( 

{ 


S«t  t to  tho  desired  velue  (p+l<t<n+l),  eet  P ■ •nd  go  to  1, 
Step  1.  If  I - 0,  go  to  2.  Otheivlse,  choose  l*sl  ••id  pivot 

— j: — y "7 

either  on  s^  . or  on  , where  J,  snd  J are  defined  by 


'•ij' 


I*:!! 


C3l  ■ . — ~ • mn  r » 

•nd 

/AN  — — s-  - Bln  — 

respectively.  Then  set  k •-  k + I,  end  go  to  1. 
Step  2.  Generate  the  Inequality 


k k 

♦ s > -L 


'o  - j^-oj^j  - oo  • 

If  the  nueber  of  Inequalities  generated  so  far  exceeds  t,  or 

ijvi®  - 0,  or  ajj  > 0.  » Jcjjj,  V go  to  3. 

Othetwlae,  choose  •“o*‘  that  aj^^  < 0 for  sosm  Jsj||,  pivot 

on  a^  defined  by 
tj* 

'•‘jJ  ^ l^ii 

'•‘jJ  < 0 

eai  go  to  2. 
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gf  p 3»  Let  tf  b«  the  index  eet  for  Che  Inequellclef  generated 
ao  far.  Solve  the  problaa 

' ^ ‘oj^j  - ‘oo*  0 < y £ <l}» 

and  let  (w^^t  be  the  optimal  aolutlon  found, 

o 

If  < w , go  Co  4.  Otherwise  set  k ♦-  k + 1 and  go  to  3a. 
o o 

Step  3a.  This  is  Step  3 with  the  following  changes: 

(a)  yen  to  be  added  to  the  constraints  of  Che  minimisation  problem 

(b)  w to  be  replaced  by  ^ 

o 

lti-1  k 

(c)  If  > P*  •tops  y la  optimal. 

Step  4.  Solve  the  linear  program 


(uXy^b) 


max(u(b  - Dy*‘*^)|uA  < c} 


k^l 

(or  its  dual  (LP(y  ))  and  let  u be  the  optimal  solution  found.  Let 

- . k-H„  _ k+1.  , k+li 

P •-  minlP,  u (b-Dy  )+gy  ]. 

If  e < wj^lnd  Step  4 was  entered  from  3a,  stop: 
is  optimal  for  (Pj^). 

If  P < w'‘*Jnd  Step  4 was  entered  from  3,  iSien  y**^^)  1* 

optimal  for  (LP^).  Set  pam,  k*-k<fl  and  go  to  3a. 

Othonrlse,  set  k •>  k 4-  1,  generate  the  inequality 

*e  ^ ‘L  • 

o oj  J oo 

wImto  a**  ■ tt^  and  a^.  la  the  eomponant  of  (o^  - g),  and  go  to  3 

on  oj 


(if  stop  4 


iimd  from  3)  or  to  3a  (If  Step  4 was  entered  from  3a) . 
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I- 


k 


Dl»cu«>loa.  At  every  Iteretion  of  etep  1 e choice  has  to  be  made 
between  the  two  types  of  pivots  defined  by  (3)  end  (4).  Since  the  strength 
of  the  cut  obtained  by  a sequence  of  steps  1 grows  with  the  alae  of  the 
coefflclenta  a and  -a  JsM,  It  aeema  reaaonable  to  chooaa  the  pivot 

OO  Oj 

which  producea  the  greateat  Increaae  (enallaat  decreaae)  In  aoaw  weighted 
SUB  of  theae  coefflclenta,  l.e..  In 


k 

a 


^ y 


As  to  the  waists  \y  one  would  like  them  to  be  propOTtlonal  to 
probability  of  y^  being  equal  to  q^  In  an  optimal  aolutlon.  However, 
such  Information  Is  usually  not  available.  On  the  other  hand,  one  may 
have  some  Information  on  the  nuaher  y of  variables  y^  that  have  to  be  at 
their  upper  bounds  In  an  optimal  aolutlon.  If  so,  one  can  use  Xj  * X ■ Y/|h),  ¥ J. 
In  the  absence  of  any  Information  of  this  type,  a reasonable  rule  seems  to 
be  to  use  Xj  ■ X ■ 1/2,  ¥ J. 

To  Implement  the  above  choice  rule,  one  can  Introduce  a column 


k - -k 
1 • 

k k 

with  components  a^.  Then  the  change  In  a • result  of  the  pivot  at 


step  k (l.e.,  the  amount  L • a 


k+l  k. 

- a ; !• 


tor  J*  - •nd  J*  - Jj*  •od  A «•“  •Ways  be  made  nonnegative.  To 

accomplish  this,  one  chooses  • j,  (l.e.,  a^  . > 0)  If  a![  - A(a^  -f  1)  > 0, 

* *■*  * 

•Bd  j*  - ^2  (!•••.  < 0)  *^0  ' 


I 

s 

I 

I 

i 

i 
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SlmlUrly.  In  Step  2 one  hae  to  chooae  a row  Again,  a 

k4>l  k 

raaeonabla  fule  eaeoM  to  be  to  inaxlalie  A •>  cr  * or  » lAloh  Itt  thla  eaaa 
can  be  axpresaed  ae  a function  of  the  index  i (uaing  the  eaaa  coluan 

b 

a,  as  above); 

^ k 

<-•01  > 

k k 

A(l)  - (aj^  - X*4j)  -j . 

•^Ji 


Here  J,  is  the  pivot  coluan  J.  prescribed  by  (9)  for  tern  i.  One 
1 ^ 

then  pivots  in  the  row  i for  which  A(i)  attains  its  ■axlasa  over  z||SX°* 


subject  to  SOM  condition  defined  so  as  to  prevent  the  repetition  of  bases 


(for  instance,  the  condition  My  require  all  variables  leaving  the  basis 
to  rcMin  nonbasic  for  a certain  nuad>er  of  iterations) . 


4.  WuMrical  Exaaple 
Consider  the  problsr 
■In  X2+3*3+’5x^ 

Xj^-  X2+  Xj-2x^+yj  +2X7“  yg  ■ Z 

Xj-2x2-8x3+6x^  y7+  Tg  " 

Xj  ^0,  J • 1 4;  yj,  y^  - 0 or  15;  y^,  ■ 0 or  5 


-20' 


Step  0. 

The  optimal  solution  to  (LP) , tha  linear  program  obtained  from 
(P)  by  replacing  "y^,  y^  » 0 or  15,  y^,  y^  • 0 or  5"  by  "0  < y^,  < 15, 

0 £ yg  _ is  . 0,  J . 1 ^5  - 6.  ^6  " 12.  " 0,  7g  - 5. 

with  the  associated  simplex  tableau  1,  where  ■ {8}  (the  index  set  for 
the  nonbaslc  co  ponents  of  y at  their  upper  bound). 


1 

■*i 

“’‘2 

■*3 

-y? 

-^8 

1 

z 

■ 1 

-20 

r“ 

1 

-1 

-1 

-3 

-5 

-2 

4 

^5 

6 

1 

i 

m 

-1 

1 

-2 

2 

-1 

^6 : 

12 

! -J 

1 

-2 

-8 

6 

-1 

1 

Tableau  1. 

.o 


We  replace  by  a^^  = a^^^  + Sa^^  for  1 ■ 0,  5,  6,  and  form  the 


column  a°  ■ a°  + a®.  This  . -oduces  tableau  2. 


^6  121 


^e^leeu  2. 

have  I*  - 2,  « and  we  eel  t^ACp-fl  <4<n+l). 
Step  1.  We  choose  1^-5.  For  choosing  the  pivot  typo,  we  use 
the  rule  dlsoussed  at  the  end  of  section  S,  with  * X ■ ^ J* 
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i 

I 

( 

I 


Since  + 1)  - 0.  we  choose  defined  by  (3). 

Pivoting  on  a°^  = 1 and  updating  a^  (by  adding  the  new  non-baslc 
column  corresponding  to  y^)  yields  tableau  3. 


1 -yg  -*2  -’'3 

■*4 

■^7  ’^8 

■yj 

1 j 1 -2  -2 

-7 

0 3 

4 

-2 

2 -1 

2 

i -1 :! 

8 

-3  2 

-2 

Tableau  3. 


Here  ■=  {l}.  - [2,3,4},  = [6},  - {5,7,S}.  Since  ij  ^ 0, 

we  go  to  1 . 

Step  1.  We  choose  i*  = 6 and,  since  a^^  - ■|(agj  + 1)  * 31/2  > 0,  we 
again  choose  Pivoting  on  a^g  and  updating  a^  then  yields  tableau  4 


1 

-^5 

-^2 

■^3 

■^7 

00 

1 

■yj 

z 

15 

1 

8 

23 

* "8 

79 

- T 

7 

f 

21 

* 8 

38 

8 

25 

8 

6 

10 

. 10 

2 

10 

4 

14 

*1 

5 

8 

’ 8 

8 

8 

8 

■ 8 

8 

1 

1 

9 

1 

3 

2 

1 

’‘4 

2 

8 

■ 8 

8 

8 

8 

8 

8 

Since  l' 


Tableau  4. 
0,  we  go  to  2. 


Step  2.  From  tableau  4 we  generate  the  inequality 


+ ¥ ^ 


-o  8 ^5  " i ^^6  ■ ^8  ^7  ^4  ^8  - 
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We  apply  3 more  times  Step  2 in  order  to  obtain  t ■ 4 cute, 
■rtjfe  sequence  of  pivots  and  the  cuts  obtained  by  them  are  ah'wn  in 


tableaus  4-7. 
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I 


I 


Step  3.  We  solve  the  linear  program 


min  w 


"o  + 5 >'5  5 ’'6  ' ^ ’'7  ^ ^8  - “ 


11 


59 


''o'  5 ^5  To  ^6  ■ 2 y?  10  ’'S  - 2 

175-  ho-  -7 

“o  * H 75  - I 76  ! 7,  + ^ 78  2 - H 


0 < y^j  < 15,  0 < y^,  yjj  < 5 


7’  '8 


and  find  that  its  optimal  solution  is  (w^,  y)  = (-20;  6,  12,  0,  5). 
Since  w > w = -20,  we  go  to  3a. 

Step  3a.  We  solve  the  discrete  programming  problem  obtained 
from  the  linear  program  of  £-;ep  3 by  requiring  each  component  of  y 
to  be  equal  to  one  of  its  bounds,  and  find  the  optimal  solution 
(w^,  y^  “ (-12;  0,  15,  0,  5).  We  go  to  4. 

Step  4.  We  solve  (LP(y))  rather  than  (LD(y))  by  setting 
yi  0,  y2  » 13,  y3  = Of  y^  = 5 in  Tableau  4,  and  reoptimizing  the 
resulting  linear  program,  as  shown  in  Tableaus  5-6: 


-’'1 

■*2 

■*4 

. 8 

5 

z 

-12 

16 

79 

-20 

-7 

9 

9 

9 

■ 2 

9 

“ 10 

1 

5 

10 

9 

10 

9 

3 

2 

1 

10 

-1 

*3 

1 

1 

V 

. 8 

9 

Tableau  5.  Tableau  6. 


I 


vOiOS 
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Since  the  optimal  solution  x gives  cx  + gy  “ -12  < w^,  (w^,  y) 

Is  an  optimal  solution  to  (P^),  and  (x,  y)  Is  an  optimal  solution  to  (P), 
with  X = (5,  0,  1,  0),  y = (0,  15,  0.  5).  and  cx  + gy  - -12. 
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ERRATA 

for 

Benders *■  Method  Revisited 

by 

E.  Beles  and  C.  Bergtheller 


The  proof  of  the  last  statement  in  Theorem  2 (starting  on  top 
of  page  11)  has  a flaw.  The  Theorem  Itaelf,  however,  is  correct. 
Please  substitute  the  attached  proof. 


I 


To  prove  the  last  statement  of  the  Theorem  by  contradiction, 
suppose  that  for  some  hcS(y)  the  Inequality 

h ^ h 

w + Z a ,y,  > a , 

» j.»  J - °° 


which  can  also  be  written  as 


w + (u*h)  - g)y  > , 


is  implied  by  the  other  inequalities  of  (P^) . Then 

u^'b  = mlntw^  + (u*‘d  - g)y|w^  + (u^S  - g)y  > u'S,  keS\{h},  0 < y < q}, 
and  this  minimum  is  attained  for  the  same  point  (w^.y)  for  which  attains 

its  minimum  in  (P^).  Furthermore,  the  dual  of  the  linear  program  in  the 
brackets  has  an  optimal  solution  (X.)  satisfying 


keS-^h} 


I,  \>0; 


< “ - gj.  if  yj  - 0 


I > uNj  - gj,  If  fj  • gj 

Denoting  n'^  = {JcnIo  < 7^  < q^},  from  the  above  we  have 

CSZZ^Xk”*'  " u**)**,  =0.  JaN'*’ 
keS-(h}  J • 


Furthermore,  any  constraint  with  a positive  multiplier  must 
be  tight  at  (w^,y),  i.e.,  > 0 implies  keS(y). 


e 
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On  the  other  hand,  each  u , kcS(y),  la  a baalc  optimal  solution  to 
LD(y).  Though  the  bases  associated  with  the  various  u'^,  keS(y),  differ 
among  themselves,  they  all  have  among  their  basic  columns  those  columns  a^ 
of  A which  are  basic  In  the  optimal  solution  (x,y)  to  (LP),  If  denotes 
the  set  of  these  columns,  then  |r+|  = m - 1n''’|,  where  m Is  the  number  of  rows 
of  A (and  of  D) . Thus , we  have 

u a^  = Cj^  , 1 eR 

for  every  kcS (y) , and  hence 

(7')  “ uSa.  = 0,  1«R*’. 

keS-{h}  ^ 


Denoting 


6 * > X.  - u , 
keS-{h} 

equations  (7)  and  (?')  can  be  restated  as 


(8) 


6dj  - 0 

6a.  «■  0 


leR^, 


where  |n^|  + jR^j  = m,  and  where  the  m vectors  d^,  a^  are  linearly 
Independent,  since  they  are  the  columns  of  the  basis  associated  with 
(x,y). 

Thus  the  unique  solution  of  (8)  Is  6 = 0,  and  from  (7)  this  Implies 
Ic  ^ 

that  the  vectors  u , kcS(y)  are  linearly  dependent,  contrary  to  the 


assumption  that  they  are  extreme  points  of  U. 


